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ABSTRACT 

This manual has four purposes. They are: (1) to list 

test analysis services available to teachers, (2) to explain 
information on the analysis printouts, (3) to provide help in 
interpreting analysis results, and (4) to suggest possible uses of 
test analysis data. It is noted that test analyses services are 
available to teachers for teacher-made tests and surveys if standard 
answer sheets are used, as well as tor some standardized tests. Any 
one or all of the following services may be selected: (1) class 

performance analysis, (2) item analysis, (3) frequency distribution, 
and/or (4) response analysis. It is felt that by using the data 
generated, teachers will be helped in planning instruction, in 
evaluating student progress, and in improving test items. (Author) 
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Introduction 

This manual has four purposes: 

To list test analysis services available to teachers. 
To explain information on the analysis printouts. 

To provide help in interpreting analysis results. 

To suggest possible uses of test analysis data. 

Test analysis services are available to teachers for teacher- 
made tests and surveys if standard answer sheets are used. 
These services are also available for some standardized tests. 

Answer sheets arc scored and analyzed; results arc returned on 
printout sheets. Any or all of the following services may be 
selected: 

A. Class performance analysis 

B. Item analysis 

C. frequency distribution 

D. Response analysis 

Use of data can help teachers in planning instruction, in 
evaluating student progress and in improving test items. 
Suggestions have been listed for using each printout; more- 
over, additional ways of utilizing these printouts will be 
found through use. 




Class Performance Analysis 

Class performance analysis printouts provide a complete 
picture of each individual student* s performance on a test. 
This sheet shows the per cent and total number of correct 
answers, the total number of incorrect answers and the total 
number of items not answered for each student. The 
printout also shows the specific response of each student 
to each item as well as listing standard scores for students. 



The class performance analysis aids the teacher in: 

1. Scoring and arranging results of tests in usable 
form. 

2. Diagnosing strengths and weaknesses of individual 
students. 

3. Grouping students according to varied levels of 
instruction. 

4. Making individual pupil comparisons of pre- and 
post-test results. 

5. Grading by use of per cent or standard score. 
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Explanation: Class Performance Analysis Printout 



The numbers below refer to the numbers circled on the sample printout. 

General information includes: 

1. Reading from left to right, subject, date, grade, section 
number, school number and teacher's name. 

2. Number of students and number of questions. 

3. Marking Code: 

a. Dash (-) indicates a correct answer 

b. Letters A through 1* indicate incorrect answers. 

c. Asterisk (*) indicates no answer was given. 

4. Question Number. To read one-digit numbers, use the first group 
of numbers 1-9 on the bottom scale. For two-digit numbers, read 
the top number as a multiple of 10 and add the bottom digit. 



EXAMPLE: 1234567890123456 iQ)9 0 

To read Item 18, read the 1 on the top scale 
as ten, then locate the eight to the right. 



5. Key. The row of letters to the right of the word KEY indicates 
the correct response for each item. Read the number of the 
question; then directly below find the letter of the alphabet 
which indicates the correct answer. For example, C is the 
correct answer for Item 1. 

Information for each student includes: 

6. %. Per cent of questions answered correctly. 

7. RIGHTS TOT. Total number of correct responses. 

8. WRONGS TOT. Total number of incorrect responses. 

9. N-A. Total number of items not answered. 

10. ST NO. Students identification number if used. 

11. STiJDENT NAME. Student’s name. 

12. STD SCR. Standard scores on the printout apply only to the group 
for whom the particular frequency distribution is listed. Standard 
scores are units of measurement which tell the distance a given 
score is from the mean. Standard scores used in Escambia County 
range from a low of 20 to a high of 80. The mean of a standard 
score distribution is 50; the standard deviation is 10. In a normal 
distribution, 68% of pupils' scores will lie between 40-60; 95% 
between 50-70; and 99% between 20-80. 



Example: Mark Ashby had a raw score of 32 and correctly answered 

64% of the total number of items. He had five wrong answers; thirteen 
questions were not answered. His answer for Item 37 was B; the cor- 
rect answer was C. Mark correctly answered ten out of the first 
eleven questions; however his answer for Item 12 was incorrect, lie 
failed to answer Items 40-44. His standard score was 56 which indi- 
cated that the score was just above the mean. 




Item Analysis 



Item analysis printouts record the performance of the total 
group on each item and the frequency with which the high- and 
low-scoring groups chose alternate responses to each item. 
Both the difficulty level and the discrimination index are 
also listed for each item. 



The item analysis aids the teacher in: 

1. Analyzing pupil performance on each test item. 

2. Detecting learning difficulties of the class 
as a whole. 

3. Identifying areas or skills needing initial 
instruction, review or remediation. 

4. Indicating pupil achievement of objectives. 

5. Selecting items for development of a test. 

6. Identifying structural or content defects in 
test items. 

7. Revising and refining tests. 
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Explanation: Item Analysis Printout 

The R*£»bcrs below refer to the number circled on the sample printout. 

1. Reading from left to right, subject, date, grade, section number, 
school number and teacher's name. 

2. Number of students and number of questions. 

3. Dash: Indicates correct response to an item. ° 0 indicates per cent 

correct. 

4. ITEM: The number of the test question* Odd-numbered items are on the 

left; even-numbered items are on the right. The printout shows the 
number of responses to each alternative (A, B, C, D, E) for each item. 
The top row lists responses for the upper third of the group based on 
total rights; the second row lists the lower third of the group; the 
third row lists the total group. 



n.xamplc. Item 5. 11 students in the upper third of the group chose 

B which is the correct answer; one student in the lower third chose 
answer B; 20 students in the total group selected B. No students in 
the upper third selected A, C, I), or H; in the lower third no student 
chose A but two selected C, \wo selected D and two selected !i; in the 
total group no one selected A but three selected C, three selected 1) 
and three selected F.. 



5. % (per cent). Indicates the level of difficulty of each item. Lists 

the per cent of students correctly answering each item. 



Example. Item 5. 100 p *> of the students in the upper third answered 

Item S correctly; 9* of the lower third answered correctly; 58*6 of the 
total group correctly answered Item 5. j 



6. DISC INDEX (Discrimination Index). A measure of how well each item 
discriminates or distinguishes between those who scored high on the 
test and those who scored low on the test. The discrimination index 
ranges from +1 .0 to -1.0, A positive correlation indicates that the 
item was answered correctly by more high scorers than low scorers; a 
zero correlation indicates that the item was answered correctly by as 
many low scorers as high scorers; a negative correlation indicates that 
the item was answered correctly by more low scorers than high scorers. 



Example. On Item 22, 7 students in the upper third answered correct- 
ly; no students in the lower third answered correctly; the discrim- 
ination index is .64. However on Item 17, 7 students in the upper 
third answered correctly; 10 students in the lower third; the discrim- 
ination index is -.27 since more students in the lower group answered 
correctly. On Item 1, 11 students in the upper group answered 
correctly and 11 students in the lower group answered correctly; 
therefore the discrimination index of the item is .00 since the same 
number of students in each group answered the item correctly. 

i. is 
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Frequency Distribution 



Frequency distribution printouts are graphic presentations of 
students* scores indicating relative performance on a particu- 
lar test. This sheet lists the distribution and the frequency 
of the students' total scores based on total right answers. 
Also included arc mean, median, standard deviation, standard 
error of measurement , KR-20 reliability coefficient ami 
standard scores. 



The frequency distribution aids the teacher in: 

1. Determining the average performance of the group. 

2. Indicating the variability or spread of the scores. 

5. Determining the reliability of the test. 

4. Comparing a pupil's performance with the group’s 
performance. 

5. Making group comparisons between pre- and post-test 
results . 

6. Comparing one group to other groups on the same test. 




FOLD OUT FOR 
SAMPLE PRINTOUT 



10 




-U- 



-42- 



44- 



-24 40- 



, o 

ERIC 



•d 



11 



^14 



a 



FREQUENCY distribution 




PAGE 


SECTION 30 SCHOOL 60 JONES 


( 9 \[ NUMBER OF STUOENTS 
^LNUMHEir OF fiUE&TinNS 


cl 4 0 3 


^ MEAN = 26.29 x-v ! 


_ ST OEV = 6.31 (•$) 


(83 ST AT 1 ST 1 CS 1 N RA# SCORES 


Aj) MED IAN a 29.00 


- A i 




STANDARD E.RRCR = 2.S2 






HR-20 RELIABILITY TRl = 


.so : 





J* 

1C 



;77 

71 



H 



17 

]» 

X 



II 

ill 



)l 

]l. 

10 



!« 



w 




Explanation: Frequency Distribution Printout 

The numbers below refer to the numbers circled on the sample printout. 

1. Reading from left to right, subject, date, grade, section 
number, school number and teacher's name. 

2. Number of students and number of questions. 

3. STD SCR. Standard scores on the printout apply only to the group 
for whom the particular frequency distribution is listed. Standard 
scores are units of measurement which tell the distance a given score 
is from the mean. Standard scores used in Escambia County range from 

a low of 20 to a high of SO. The mean of a standard score distribution 
is 50; the standard deviation is 10. In a normal distribution, 65^ of 
pupils' scores will lie between 4C-60; 95* between 30-70; and 99‘i> 
between 20-80. 

4. TOT RT. Total right answers. 

5. # OF STUDENTS. Number of students making a designated score. 

6. PLOT OF FREQUENCY DISTRIBUTION. M EQUALS l. Indicates how many 
students arc represented by each M. 

7. M. Tallies indicating individual scores. 

S. STATISTICS IN RAW SCORES. The following arc computed in raw scores: 
mean, standard deviation, median, standard error and KR-20 reliability. 

9. MEAN. An arithmetic "average" of a set of scores. 

10. STANDARD DEVIATION (S.D.). A measure of the variability or "spread" of 
a set of scores. The closer the scores arc to the mean, the smaller the 
standard deviation. In a normal distribution, 6S% of the scores arc 
within the range from one S.D. below the mean to one S.D. above the mean. 

11. MEDIAN. A point dividing scores into two equal groups. The "middle” score. 

12. STANDARD ERROR. No test has perfect reliability with the result that an 
individual should be considered as scoring within a range from several 
points below to several points above the obtained score on a test. For 
example, a test has a standard error of 4 points. This means that there 
arc two out of three chances that the true test score of a person who has 
a raw score of 60 could be as much as 4 points above or 4 points below 
that score; thus the true score might be as low as 56 or as high as 64. 

13. KR-20 RELIABILITY COEFFICIENT (R). An indication of whether similar results 
would be obtained if the same test or an equivalent form were administered 
to the same students; the consistency with which a test is measuring what 

it docs measure. If the reliability coefficient is high (.75 or greater), 
one can be reasonably confident that an individual's score would not change 
substantially if he were to retake the same test or an alternate form. 



Response Analysis 



Response analysis printouts are tabulations of 
of the total group to each item. The printout 
number and the per cent of students responding 
native (A, B, C, D, L) for each item. 



The response analysis aids the teacher in: 

1. Evaluating surveys and attitudinal 

2. Analyzing responses on each item. 
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Explanation: Response Analysis Printout 



The numbers below refer to the numbers circled on the sample printout. 

1. Number of students. 

2. Reading from left to right, school number, grade, section number 
and teacher's name. 

3. Subject and date of test. 

4. Responses. Shows the number of responses to each alternative 
(A, B, C, D, E) for each item. The NA column indicates the 
number of students not responding to the item. 

5. Per cent. Shows the per cent of responses to each alternative 
(A, B, C, D, E) for each item. The NA column indicates the 
per cent of students not responding to the item. 

6. Total. Lists the total number of responses to each alternative 
(A, B, C, D, E) for the entire test. 

7. Total. Lists the total per cent of responses to each alternative 
(A, B, C, D, E) for the entire test. 



Example: Item 9. Six students or 17.65% selected alternative A; no 

students or 0.0% selected B; 23 students or 67.65% chose C; one 
student or 2.94% responded D; three students or 8,82% chose E; one 
student or 2.94% did not respond to Item 9. 
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Steps for Obtaining Test Scoring 
and Analysis Services 







A. Standard Answer Sheets 

1. The school office can requisition standard answer sheets from 
the Materials Warehouse. Use the warehouse requisition when 
ordering. 

2. Students should record responses on standard answer sheets. 

3. ?2 pencils must be used in marking the answer sheets. Do not 
use ball-point or felt pens. 

4. Student names should be gridded on the answer sheets: however 
do not grid names if it is desired that responses be anonymous . 

5. Students numbers should be gridded on the answer sheets when 
appropriate. If pre-post evaluation is desired, student 
numbers must be gridded. The same student number should 

not be assigned to any two students; a student should use the 
same number for both tests. 

B. Form: Request for Test Scoring and Test Analysis 

1. The school office should have a supply of the yellow request 
forms. Forms can be requested by telephone from Evaluation 
Services and will be sent by courier upon request. 

2. Complete all information requested on the form. 

3. Check the services requested. 

C. Preparing Materials for Scoring and Analysis 

1. Prepare keys and answer sheets as indicated on the request 
form. 

2. Send or bring completed request form, key and answer sheets 
to : 

Evaluation Services 
Educational Services Center 
5404 Lillian Highway 

D. Receiving Test Results from Evaluation Services 

1. Scoring Services : If answer sheets arc sent to Evaluation 

Services by courier, allow 3-4 days for results to be 
returned. If answer sheets arc delivered personally, it will 
require 10- IS minutes to score the answer sheets provided you 
call to schedule processing time; however remember to call 
ahead . 

2. Analysis Services : If answer sheets arc sent to Evaluation 

Services by courier, allow 7-8 days for printouts to be 
returned to the school. If answer sheets arc delivered 
personally, allow 5-4 days for printouts to be returned to 
the school; however remember to call ahead to schedule 
processing time. 

For further information, call Evaluation Services : 456-S651, ext. 226 or 227. 
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REQUEST FOR TEST SCORING AND TEST ANALYSIS 



o 

ERIC 



1.0 COMPLETE THE FOLLOWING INFORMATION. 



2.0 



1 . 1 School Name 

1.2 Teacher's Name 

1.3 Subject Name 

1.4 Date (use numerals) 

1.5 Grade 

1.6 Section Number 

1.7 Number of Student Answer 
Sheets Attached 

1.3 Number of Questions 

1.9 Number of Sections Using the 

CHECK THE SERVICES REQUESTED. 




2.1 


Scoring (printing the number of total rights on 
each answer sheet) 


□ 


2.2 


Class Analysis 


□ 


2.3 


Item Analysis 


□ 


2.4 


Frequency Distribution 


□ 


2.5 


Response Analysis 


□ 


2.6 


Test Analysis Printouts (includes 2. 2-2.5) 


□ 



5.0 PREPARE A KEY AS INDICATED BELOW. 

3.1 Mark the correct answers on an answer sheet. 

3.2 In the space for city, write the word "KEY". 

1.0 PREPARE ANSWER SHEETS AS INDICATED BELOW. 

4.1 Separate answer sheets by section. 

4.2 Place one copy of this form on top of each section of answer sheets. 

4.3 Enclose the KEY with each section of answer sheets. (If the same 
key is to be used in scoring more than one section of answer sheets, 
attach only one key.) 

5.0 SEND OR BRING THIS FORM, KEY AND ANSWER SHEETS TO: 

Evaluation Services 
Educational Services Center 
5404 Lillian Highway 



3.0 FOR FURTHER INFORMATION, CALL EVALUATION SERVICES: 456-8631, ext. 226 or 227. 
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Standard Answer Sheet 
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Contact Evaluation Services 
than the one above. 



if you 



plan to use any answer sheet other 
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